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Comparing Batch Delays and Customer Delays 

By W. WHITT* 
(Manuscript received January 25, 1983) 

For a large class of queueing systems in which customers arrive in batches, 
Halfin (1983) showed that the delay distribution of the last customer in a 
batch to enter service coincides with the delay distribution of an arbitrary 
customer when the batch-size distribution is geometric. Halfin's result can be 
applied to study the performance of complicated communication systems in 
which messages are divided into packets for transmission. Then packets are 
customers and the delay of a message is the delay of the last customer in a 
batch to enter service. If the assumptions are satisfied and if packet delays 
are easier to analyze, then packet delays can be used to calculate message 
delays. In this paper, we show that these two delay distributions are stochast- 
ically ordered when the batch-size distribution is NBUE or NWUE (new 
better or worse than used in expectation). The delays of arbitrary customers 
tend to be less (more) when the batch-size distribution is NBUE (NWUE). In 
addition to the bounds provided by the stochastic ordering, we also suggest an 
approximation for the relation between the two expected delays based on 
known results for the M B /G/1 queue having a batch-Poisson arrival process. 



I. INTRODUCTION 

Halfin 1 recently showed that for a large class of queueing systems 
in which customers arrive in batches the delay distribution of the last 
customer in a batch to enter service equals the delay distribution of 
an arbitrary customer when the batch size has a geometric distribution. 
Halfin's result is important when we study the performance of com- 
munication systems in which messages are divided into packets for 
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transmission. Then packets are customers and the delay of a message 
is the delay of the last customer in a batch to enter service. Halfin's 
result is useful to approximately describe message delays in compli- 
cated communication systems, e.g., with contention-resolving schemes 
such as Carrier Sense Multiple Access (CSMA). 1 In many of these 
systems message delay is more important but more difficult to analyze 
than packet delay. Halfin provides conditions under which packet 
delay results directly yield message delay results. 

In this paper we identify conditions on the batch-size distribution 
under which the delay distribution of the last customer to enter service 
is stochastically greater than or equal to the delay distribution of an 
arbitrary customer. We show that it suffices for the batch-size distri- 
bution to be NBUE (new better than used in expectation). The 
ordering is reversed for batch-size distributions that are NWUE (new 
worse than used in expectation). The batch size B has an NBUE 
distribution if its mean is greater than all conditional means given tail 
events, i.e., if EB > E(B - n \ B > n) for all n. A distribution is NBUE 
(NWUE) if it has increasing (decreasing) failure rate. The NBUE and 
NWUE properties are now quite standard for stochastic comparisons. 
For further discussion, see Barlow and Proschan, 2 and Whitt. 3 

As Halfin observed, his result about batch arrivals can be viewed as 
a special case of a discrete analog of Poisson Arrivals See Time 
Averages (PASTA). 4 In the same way, our stochastic comparison 
results parallel those for customer-stationary and time-stationary 
characteristics of queues. 5-7 Random quantities associated with 
batches (e.g., delays of the last customer in a batch) constitute an 
embedded sequence in the sequence of random quantities associated 
with all customers (e.g., the delays of arbitrary customers), just as 
customer arrival points or departure points constitute embedded se- 
quences in continuous time. 

Our approach is similar to that of the East German School (Franken 
et al.) because we begin in Section II with a stationary version, what 
we call an "equilibrium batch." In this setting, we easily obtain a 
representation of the expected average associated with an arbitrary 
customer that makes the desired comparisons and Halfin's result 
transparent. The representation involves the stationary-excess distri- 
bution of the batch-size distribution. (From the theory of stationary 
point processes, as contained in Franken et al., this can also be viewed 
as a consequence of the Palm theory.) 

The relation between what an arbitrary customer sees and what the 
last customer in a batch sees can be explained in part as follows. One 
customer in each batch is the last customer in the batch, but there are 
more customers in big batches than in small batches. Hence, the 
distribution of the batch size containing a last customer is the ordinary 
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batch-size distribution, but the distribution of the position in a batch 
of an arbitrary customer is the batch-size stationary-excess distribu- 
tion (see Section III. 2 of Cohen, 8 Burke, 9 and Section 5.10 of Cooper 10 ). 
Hence, the relation between the two kinds of delays reduces to the 
relation between the batch-size distribution and its associated station- 
ary-excess distribution. 

These stochastic comparison results are only qualitative. With the 
methods we use, we are unable to obtain related quantitative results. 
Moreover, the difference between the expected delays obviously will 
depend on the context, whereas the qualitative results here generally 
hold true. Following Halfin's example, we make very few assumptions 
for our stochastic comparisons. However, in Section III we examine 
quantitative results by considering the special case of the M B /G/1 
queueing model, which has a batch-Poisson arrival process. We get 
some idea about what to expect in more complicated situations by 
examining existing quantitative results for this special case. We use 
these results to obtain an approximate quantitative relationship be- 
tween expected batch delays and expected customer delays as a func- 
tion of the first two moments of the batch-size distribution. 

In Section IV we briefly show how our equilibrium batch can be 
viewed as a time-average limit. Throughout we talk about batch 
arrivals to a queue, but as in Wolff 4 the results apply more generally. 
The model need not be a queue, and for a queueing model the process 
need not be an arrival process; for an arrival process the customers in 
a batch need not arrive together. The batch is simply a label assigned 
to random variables, as we explain in Section II. 

II. THE EQUILIBRIUM BATCH 

We consider a batch in equilibrium, defined in terms of a positive- 
integer-valued random variable B and a sequence of random variables 
\Xk, k > 1}, all defined on a common probability space. The variable 
B represents the size of the batch and the variable Xj is a random 
quantity associated with the jth customer in the batch. For example, 
Xj might be a function of the delay of they th customer to enter service. 
We are only interested in Xj for j < B. In fact, we can consider Xj 
defined only on the subset \B > j\. Hence, we can speak of the basic 
data as the random vector (B, X u ■ ■ ■ ,Xb). 

The variables X u X 2 , ■ ■ ■ are typically dependent. Our basic as- 
sumption is that the events \B = j\ for j > k are independent of the 
random vector (X 1? • • • , Xk) for k > 1. This corresponds to the Lack 
of Anticipation Assumption (LAA) in Wolff. 4 

Let the probability mass function (pmf) of B be defined as 

p„ = P(B = n), n = 1, 2, ■ • - , (1) 
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and let p* be the stationary-excess pmf associated with p n , defined by 
P* = Pn/ I Pk, n > 1, (2) 



where 



p n = 1 Pk, n> 1, (3) 

k=n 

and 

I Pk = 1 kpk = EB < oo. (4) 

We are interested in the relationship between the random quantities 
associated with an arbitrary customer and the last customer in a batch 
so we can compare the expected values in these two cases. We interpret 
the expected value associated with an arbitrary customer as the 
expected value for all customers in the batch divided by the expected 
number of customers in a batch. (A way to justify this interpretation 
is described in Section IV). Because of our basic assumptions, these 
quantities are 

I Pn(EX 1 + .-. + EX n ) 

A = =i = (5) 

£ np n 

and 

QO 

L = EX B = I p n EX n . (6) 

n=l 

The desired relationships between A and L are derived from the 
following alternate representation for A. 
Theorem 1: A = £"=i p£EX n . 
Proof: Change the order of summation in (5) and apply (2) to obtain 

,1 I EX n | -£=— I = l EX n (-£ 2 -\ = l EX n p* n . 

ikpj - IsaJ n=1 
<k=i / \k=i / 

Corollary 1: (Halfin 1 ) A = Lfor all \EX n \ if and only ifp n =P*for all n 
or, equiualently, if p n is geometric, i.e., 

p n = (1 - p)p n -\ n = l,2, ... (7) 

for some p, < p < 1. 
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Proof: Sufficiency is immediate. It is well known that p n is geometric 
if and only if p„ = p* for all n (e.g., see Corollary 3.3 of Whitt 3 ). 
Necessity is almost as easy: Choose different sequences \EX n \, e.g., 
EX n = 1 if n = k, and otherwise. 

Remark: Theorem 1 and its corollaries apply immediately to distribu- 
tions as well as means. For example, our original sequence X n can be 
replaced by f(X n ) where f(x) = 7<-eo, X ), so that A is the expected 
proportion of customers for which X n < x and L = P(Xb ^ x). 

We now establish inequalities between A and L as a function of the 
shape of the batch-size pmfp„. These follow immediately from known 
stochastic-order relations between p n and p*. 

For two pmf's p\ and p\ on the positive integers, we define sto- 
chastic-order relations p\ < st p 2 „ (p n ^icPn) to hold if 

I f(k)pl < l f(k)pl (8) 

for all nondecreasing (nondecreasing and convex) real-valued func- 
tions / on the positive integers for which the sums converge. 
A pmf p n is NBUE (new better than used in expectation) if 

EB = £ p k > £ p k /p n = E(B - n\B > n), n > 1, (9) 

and NWUE with the inequality in (9) reversed. 

From Theorem 1, we obtain: 
Corollary 2: A < L for all nondecreasing sequences \EX n \ if and only if 
p* < st p n or, equiualently, if p n is NBUE. 

Proof: From (6), (8), and Theorem 1, A < L for all nondecreasing 
\EX n \ if and only if p* < st p n . It is well known that p* < st p n if and 
only ifp„ is NBUE [e.g., see Theorem 3.2 (iii) of Whitt 3 ]. For necessity, 
choose EX n = 1 for n > k, and otherwise. 

Remarks: (1) Corollary 2 remains valid with p* Sr st p„ instead of < s£ , 
which is equivalent to p being NWUE, if either A > L or \EX n j is 
nonincreasing (but not both). (2) For Halfin's problem involving 
delays, note that the delays of the successive customers in any batch 
to begin service are nondecreasing with probability one. 

We obtain another corollary using the stochastic-order relation < IC 
defined in (8). 

Corollary 3: A < L for all nondecreasing convex sequences \EX n \ if and 
only if p* < IC p n or, equiualently, if p n new is better than p* used in 
expectation, i.e., if 



00 CO 

£ Pk ^ £ Pk/Pn, 
k=l k=n 



n > 1. 

STOCHASTIC QUEUEING 2005 



Proof: Follow the proof of Corollary 2 using the convexity to treat <«. 
The characterization of p* <* p„ follows easily from the fact that 
pi <ic p 2 „ if and only if ££=„ p\ < ££.„ pi; see Definition 3.1(iv) and 
Theorem 3.2(iv) of Whitt. 3 

III. The M'/G/1 QUEUE 

To illustrate the qualitative results and obtain some related quan- 
titative results, we now consider the special case of the M B /G/1 queue 
having a batch-Poisson arrival process (see Section 5.10 of Cooper 10 ). 
Let W F , Wa, and W h be the equilibrium delay (waiting time before 
beginning service) of the first customer in a batch, an arbitrary 
customer, and the last customer in a batch. Let r and a 2 be the mean 
and variance of the service time; let m and a 2 be the mean and variance 
of the batch size B; and let B* have the batch-size stationary-excess 
distribution p* in (2), which has mean 

EB* = 2 np*= (a 2 + m 2 + m)/2m. (10) 

n=l 

Let A be the rate of the Poisson process and, for stability, assume that 
Xjtit < 1. 

From Cooper, we obtain 

From Theorem 1 and (10), we obtain 

E(W A ) = E(W f )+ 2 P*(n- 1)t 

n=l 

= E(W F ) + [E(B*) - 1]t 

= Wf) + l^Ilr + |!r. (12) 

2 2m 

From (6), we obtain 

E(W L ) = E(W f ) + (EB- 1)t 

= £(W F ) + (m - 1)t. (13) 

Let c| be the squared coefficient of variation of the batch-size B, 
i.e., the variance of B divided by the square of the mean. We can 
rewrite (12) as 

E(W A ) = E(W V ) + [m(c% + 1) - l]r/2, (14) 

so that E W A < EW h if and only if 
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mc B + 1 < m, (15) 

which is consistent with Corollaries 1 through 3 in Section II because 
m = \/p and c% = 1 - p for the geometric distribution in (7). 

In applying Theorem 1, we should observe that the lack of antici- 
pation (LAA) assumption holds for the M B /G/1 queue. Moreover, the 
Poisson property is only used to get (11); (12) and (13) remain valid 
provided that the LAA assumption holds. For example, the LAA 
assumption holds if the intervals between batch arrivals are a station- 
ary sequence independent of the successive batch sizes. 

Formulas (11) through (14) suggest an approximation for more 
general systems: 

E(W A ) - E(W F ) m(c% + 1) - 1 



E(W h )-E(W F ) 2(m-l) 



(16) 



IV. LIMITING AVERAGES 

Instead of using the framework defined in Section II, we could also 
begin with a sequence of random vectors \(B k , X ku ■ ■ ■ , XkB h ), k > 1}, 
where Bk represents the size of the fcth batch, indexed in order of 
arrival, and X kj represents the random quantity of interest (delay, etc.) 
associated with the jth customer to enter service in the feth batch. Let 
B k take values on the positive integers and let X k j be nonnegative for 
each k and j. Let Y k be the random quantity associated with the kih 
customer indexed, first according to the batch and then according to 
the order of entering service, defined by 

Y k = X jm , B x + • • ■ + Bj-i + m = k < B x + • • • + Bj 

for k > 1. 

The limiting average value of X k j over all customers is naturally 
defined by 

I Yk 
A = lim — . (17) 

We shall work with the related quantity A defined by 

n Bk 

I I x kJ 

A = lim k -= 1 f 1 . (18) 

n ^° I B k 
k=i 

In most situations, the limits A and A exist and are equal. 

We are interested in the relation between A and the limiting average 
value of Xkj over the last customer in each batch, defined by 
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£ XkBk 

L = lim — . (19) 

We assume that there exists a random vector (B,X\, • • • ,Xb) such 
that 

l B k 
lim — — = EB < oo (20) 

n— *» /I 



and 



so that 



2 X Xty B 

lim ^^ = £ £ X,- < oo, (21) 

n-.a> n j=\ 



ElXj 

i = -ir- (22) 



We also assume that 



Li X/y- 7|B A = j) 

lim — = P(B = j)EXj. (23) 

To obtain (23) it is natural to assume that the basic independence 
assumption holds for each k, i.e., \B k =j\ is independent of (X«, • • • , 
X kn ) for all 7, 7 > rc. From (23), we have 

L = EX B . (24) 

For eqs. (20) through (24) to be valid, in addition to the basic 
independence assumption, it suffices for the basic sequence \(Bk, 
Xki, • • • , XkB h )> k> 1} to be stationary and ergodic. 

With (22) and (24) we obtain the framework defined in Section II. 
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